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Claims. 

1 A method of deriving a 3D representation (30) of at least part of an object (3) from 
correlated overlapping 2D images of the object acquired from different spaced apart 
- viewpoints (CM, CM') relative to the object, the separation between the viewpoints 
' not being precisely known, the method comprising the step of digitally processing 
the 2D images to form a 3D representation which extends in a simulated 3D space m 
dependence upon both the mutual offset between correspondences of the respective 
2D images and a scaling variable, the scaling variable being representaUve of the 
separation between the viewpoints at which the 2D images were acquired. 



10 



2 A method of deriving a 3D representation (30) of at least part of an object (3) 
from a 2D image thereof, comprising the steps of illuminating the object with 
structured projected optical radiation, acquiring a 2D image (II) of the illuminated 

15 object, correlating the 2D image with rays of the structured optical radiation, and 
digitally processing the 2D image to form a 3D representation which extends in a 
simulated 3D space in dependence upon both the correlation and a scahng variable, 
the scaling variable being representative of the separation between a location ^from 

20 which the structured optical radiation is projected and the viewpomt at which the 2D 
image is acquired. 

3 A method as claimed in claim 1 ^ta^wherein a view of the representation 
(30) in the simulated 3D space is displayed and the scaling variable is entered by a 



25 



user. 
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4 A method as claimed in^^T^ comprising the step of acquiring 
overlapping 2D images fron>a camera (CM) which is moved relative to the object, 
the net movement of the camera not being fully constrained. 

5 A method as claimed in claim 4 wherein the respective orientations of the camera 
(CM) at the different viewpoints relative to a reference frame which is fixed with 
respect to the object (3) differ by less than 45 degrees. 

6. A method as claimed in claim 5 wherein the difference between said respective 
orientations of the camera (CM) is less than 30 degrees. 
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7. A method as claimed in claim 6 wherein the difference between sa,d respective 
orientations of the camera (CM) is less than 10 degrees. 

8. A method as claimed in^^L^^^rcin the 2D images are acquired 
5 by a hand-held camera (CM). 

9 A method as daimed i^l^Ls-W* wherein a. leas, one 2D image is 
acquired by a camera (CM) whose orientation is determined from an output s.gnal of 

an inertial sensor (G). 

10. A method as claimed ^^iL^^^in the 3D representation (30) 
is generated by projecnons\rom positions on a straight line (V) in emulated 3D 
space which corresponds to the straight line joining respective perspective centres o 
said 2D images or joining respective perspective centres of said structured o P t,cal 
radiation and 2D image of the illuminated object (3). 

11 A method as claimed in claim 10 wherein said straight line (V) in simulated 3D 
space is determined from a pencil of projections from correspondences of ahgned 
20 2D images (II, 12). 

12. A method as claimed in claim 10 wherein said straight line in simulated 3D space 
(V) is determined from the intersection of planes (0 C P10 P , 0 C P20P) defined bya 
least one perspective centre (0 C , OP) and at least two pairs of correspondences (PQ) 
between acquired 2D images (II, 12). 

13 A method as claimed in^rUUn^^ wherein said scaling variable is 
varied by the user to enable\he 3D representation (Rl) to be fitted to another, 
similarly derived 3D representation (R2). 

14 A method as claimed i^^Lr^ wherein the 3D presentation (30) 
is generated from the intersection of respective projections from spaced apart 
perspective centres (0 C , Op), the perspective centres being derived from the mutual 
offset between a first pair of correspondences (PQ) between respective 2D .mages 
(II 12) and from a further mutual offset between a second pair of correspondences 
between respective 2D images, further pairs of correspondences are denved from a 
search constrained by the above perspective centre determinaUon and the 3D 
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representation of the object is derived from the further pairs of correspondences and 
the projections. 

15. A method as claimed in claim 14 wherein said calculation is performed on fewer 
5 than one thousand pairs of image correspondences (PQ). 

16. A method as claimed in claim 15 wherein said calculation is performed on fewer 
than one hundred pairs of image correspondences (PQ). 

10 17. A method as claimed in claim 16 wherein said calculation is performed on fewer 
than fifty pairs of image correspondences (PQ). 

18. A method as claimed in claim 17 wherein said calculation is performed on eight 
or fewer pairs of image correspondences (PQ). 

15 

19. A method as claimed in claim 18 wherein said calculation is performed on two or 
three or four pairs of image correspondences (PQ). 

20. A method as claimed in ^^d-fr-^oii^g the step of repeating the 
method of claim 1 e^to^by digitally processing further 2D images of the .object 
acquired from different further viewpoints (CMA, CMA') to form a further 3D 
representation, the first-mentioned 3D representation and the further 3D 
representation being combined by manipulations in a simulated 3D space mvolvmg 

25 on e or more of rotation and translation, any remaining discrepancies between the 3D 
recpresentations optionally being reduced or eliminated by scaling one 3D 
representation relative to the other along at least one axis. 

21 A method as claimed in claim 20 wherein at least two of the 3D representations 
30 (Rl, R2) are simultaneously displayed on screen (5) and their manipulations are 

performed in response to commands entered by a user. 

22 A method as claimed in claim 21 wherein the manipulations of the 3D 
representations (Rl, R2> are performed under the control of a computer pointing 
device (6) operated by the user. 
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23. A method as claimed in^^J^^wherein a distortion parameter is 
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entered by the user and applied to said first-mentioned and/or said further 3D 

representation. 

24 A method as claimed in claim 23 wherein an mitia. 3D representation (30% 
Rgure 9) in simulated 3D space is generated by intersecting projections from spac d 
lit perspective centres, and the initiai 3D representation ts rotated whtis 
conllin. the points of the initia. 3D representation which are generated from the 
nTrstlg projections to Ue on the projections of those features from *- 
^.perspective centres, thereby forming a further 3D represen.at.on (30C, 

Figure 9). 

25 A method as ciaimed i„ C !^/l»^wherein a further parameter 
ZLZ of curvature of fields enured by the user and used to adjust the curvature 
of field of said first-mentioned and/or said further 3D represents. 

26 Image processing apparatus for deriving a 3D representation of at leas, part of an 
fbj Z f om corre,a.ed overiapping 2D images of the object acomred from dtffe™ 
snail apart viewpoints relative to the object, the apparatus compnsmg mage 

, rdrmeans (4, which is arranged to digit* process the 2D imag« .o form a 
' 'Dotation (30) which extends in a singed 3D space in dependence upon 
bl the mutual offset between correspondences of the respective 2D unages and 
"variable, the seating variabie being representative of .he separation between 
the viewpoints (CM, CM') at which the 2D images were acqmred. 

27 image processing apparatus fo, deriving a 3D representation of a. leas, part of an 

-he illuminated object, the object being illuminated „«h 
.^optica, virion P-jected from a location (OP, spaced apart from *e 
vHoin. (OO a. which the 2D image is acquired, the 2D image betng correlated 
- Iirlcld radiation, the appals comprising digiu, P~« < 
arranged .o form a 3D representation which extends ,n a emulated 3D space ,n 
ZnLce upon both tite correlation and a scaling variable, me scaltng vanable 
hi of the separation between .he location ^ 
35 sJLed optical radiation is projected and the viewpotnt at wh.cn me 2D .mage 
acquired. 

28. Appararus as claimed in cialm 26 ^touil comprising display means (5) 
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arranged to display a view of the representation in simulated 3D space, the size of 
the displayed representation being dependent upon the value of the scaling vanable . 

29 Image processing apparatus as claimed in claim 28, further comprising a camera 
(CM) whose position and/or orientation are not fully constrained with respect to the 
frame of the object, the camera being arranged to acquire said 2D images. 

30 Apparatus according to claim 29 comprising inertial sensor means (G) arranged 
» determine the orientation of the camera relative to the object at the una of 
acquisition of said 2D images. 

3 1 Apparatus as elated in i^a*«^30.which U arranged to generate the 
3D representation from the'Ursecuon of respective projections from spaced apart 
perspective centres (prl, Pr2/or2'), the perspective centres being denved from the 
mutuai offset between a first pair of correspondences between respecuve 2D , mages 
and from a further mutual offset between a second pair of correspondences between 
respecuve 2D images, to derive further pairs of correspondences from a search 
constrained by the above perspective centre determination and to denve the 3D 
representation of the object from the further pairs of correspondences and the 
projections. 

32 Apparatus as claimed in^l^^^r^ - arranged to derive a 
further 3D representation f£m further intersections of further projections from 
further perspective centres (CMA.m CMA'), the apparatus including combmmg 
means (4) arranged to combine the first-mentioned 3D representation and the further 
3D representation by manipulations in a simulated 3D space involving °™ « "™ 
of rotation and translation, the apparatus further comprising scaling means (BN Wl, 
W2) arranged to reduce or eliminate any remaining discrepancies between the 3D 
> representations by scaling one 3D representation relative to the other along at least 



one axis. 
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33. Apparatus as claimed in claim 32 which is arranged to display both 3D 
representations (Rl, R2) simultaneously and to manipulate them m simulated 3D 
space in response to commands entered by a user. 

34. Apparatus as claimed in claim 32 <*-ete*^- which is arranged to correct 
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distortion of said first-mentioned and/or sa,d further 3D representation resu.ung 
from an incorrect or incomplete calculation of a said perspective centre. 

35 Apparatus as Caimed in££e£rm^e^vhich is arranged to correct the 
curv^re of fie,d of said ^.-mentioned and/or said further 3D representation 30 

llting from an incorrect or incomplete emulation of a s,d perspective 
centre (pr2' - Figure 9). 

36 A method of determining the motion of a camera (CM) relative to an object (3) 
0 in the fid of view of the camera comprising the steps of projecting the oaths LI. 

L2 U Fi-e 4) of features of the image of the object to a common van.shmg 
(VP) 'and determining the vector (V) between the perspective centre of the 
camera (O) and this vanishing point. 

' 5 37. Apparatus for determining the motion of a camera relative to an o* ec . i n the 
fie.d oTview of the camera comprising means (4) for projectmg the patta (LL L2, 
^ Rgur. 4) of features of the image of the object to a common vamshvn 
"d means for determining the vector (V) between the perspecuve centre (O) of the 

20 camera and this vanishing point. 

38 A method of generating a 3D reconstruction of an object (3) comprising^ steps 
Z pXin. i-ses of <•» object acquired by mutual* aiigned cameras (CM, CM 
"nto—d 3D space from aligned virtual projectors (pri, pr2), the separauon of 

25 me virtual projectors being variable by the user. 

39. Apparatus for generating a 3D reconstruction of an object (3) 
alt Jd virtual projector means (pr!, pr2) arranged to project tmages of me obje« 
by mully aligned cameras into simuiated 3D space, the separate of the 
30 virtual projectors being variable by the user. 

40 Apparatus for generating a 3D representation of at leas, part of an object (3) 
ftm"t .mage of the projection of structured optical radiatton on o * 
IwTc. surf ce and from at least one calibration image (12) of the project™ of he 
35 rired optica, radiation onto a surface displac. f,m 

apparatus comprising image processmg means (4) arrange. ' * 
correspondences (PQ) between a. least one calibration .mage and the object .mage 
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and optionally a further calibration image, and reconstruction processing means 
arranged to simulate a first projection of the object image and a second projection 
linking respective correspondences of at least two of the correlated images and to 
derive said 3D representation from the mutual intersections of the first and second 
projections. 

41 Apparatus as claimed in claim 40 wherein the first and second projections are 
from a baseline (V) linking an origin of the structured optical radiation (Op) and a 
perspective centre (0 C ) associated with the images (II, 12), the reconstructs 
processing means (4) being arranged to derive said baseline from the correlate 

(PQ). 

42 Apparatus as claimed in claim 40 ^terrrr^ wherein the image processing 
means (4) is arranged to correlate two or more calibration images and to determine 
the spacing between origins of the first and second projections (0 C , Op) in 
dependence upon both the correlation of the two or more calibration images and 
input or stored metric information associated with the calibration . 

, 0 43. Apparatus as claimed ifi^^L^M^fi^ comprising projector 
" means (PR) arranged to project the structured optical radiation onto the object 
surface and at least one calibration surface (Tl, T2). 

44 Apparatus as claimed in^&^ com P risin S a camera 
25 (CM) arranged to acquire thC object image (II) and at least one calibration image 

(12). 

45 Apparatus as claimed i„,»y-of-*tarr^^ comprising at least one 
calibration target (Tl, T2) which in use is illuminated by the structured radiation. 

46 Apparatus as claimed in-ay-e^akr^O-to-^ wherein the image processing 
means (4) is arranged ^correlate pixels in one of said images (II) with 
corresponding locations in the other of said images (12) by comparing the local 
radiometric distributions associated with said pixels and locations respectively. 
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47 Apparatus as claimed in claim 46 wherein the image processing means (4) is 
arranged to allow a radiometric and/or geometric distortion during the correlation 
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process. 

48 A method of generating a 3D representation of an object (3) from an object 
imaoe (II) of the projection of structured optical radiation onto the object surface 
5 and from at least one calibration image (12) of the projection of the structured optical 
radiation onto a surface displaced from the object surface, the method comprising the 

steps of: 

i) correlating at least one calibration image with the object image and optionally with 
10 a further calibration image; 

ii) simulating a first projection of the object image and a second projection of the 

structured optical radiation, and 

15 iii) deriving said 3D representation from the mutual intersections of the first and 
second projections. 

49 A method as claimed in claim 48 wherein the first and second projections are 
from a baseline (V) linking an origin of the structured optical radiation (Op) and a 
perspective centre (0 C ) associated with the image respectively, said baseline being 
derived from two or more pairs of image correspondences (PQ). 

50 A method as claimed in claim 48 <*^a**-4^herein two or more calibration 
25 images are correlated and the spacing between origins of the first and second 

projections (0 C , Op) is determined in dependence upon both the correlation of the 
two or more calibration images and input or stored metric information associated 
with the calibration images. 

30 51 A method as claimed in^-e^teims^8-^©- wherein regions (R) of said 
images (11, 12) are correlated by comparing the local radiometric and/or colonmetnc 
distributions associated with said regions. 

52. A method as claimed in claim 51 wherein a radiometric and/or geometric 
distortion is allowed between potentially corresponding regions (R). 
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